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absteactH 

congress has reguested that the Hational Institute of 
Education (NIE) assess the current effectiveness of compensatory 
education programs in meeting their fundamental purposes^ and examine 
a alternative methods by which the effectiveness of compensatory 
programs might be improved* These reguests are included in the 
provisions of Section 821, Public Law 93-*380, Ihis paper describes 
the major research projects which have been designed and which 
together will enable Nil to respond to Congress* reguests. The 35 
research projects, organized into the four areas of funds allocation, 
compensatory services, student development, and administration, are 
described* 
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The Iducatian Asandmeacs □£ 1974 (Pviblic. Law 93-^380) g thm major 
educatioa laglslation conaldated in the f3th Congress* ins true tad the 
National Inititute of Education (Nil) to conduct a- study of compansatory 
adueatlon^ iaeluriing coinfranaatory progrmffls finMcad hy States and those 
financad under authority of fitla I of the llemantary and Sacondary Act 
(ISEA). Tlmt title, the largest Federal education efforts provided $2 
billion in 1976. Most of these fusds ware used to Improve eduGational 
prograsis for low^achieving students in school, districts serving children 
from lotir^incoma famUlaSs 

Specifically, Saetion 821 Instructed Nil to conduct a study of 

compensatory prograffis which would i 

^ Examine the fundamental purposes and ef factivanass of 
compensatory education progrMS 

^ ^aly^e the ways of identifying chlldran In greatest need 
of compensaMry education 

mm^ ^ Consider alternative waya of maating these children -s neads 

^ : - ; ^ - 

1 This paper is based on Evaluating Cofflpensatory Education i M Interto 
I: : . Report On the NIE Compensatory Education Study which was suboittad to 
the Fresidaflt and the Congreas on Decamber 30> 1976. The Interto 
Report presents a comprehensiva discussion of NIE*a stratagy in 
designing the Study and reports new data from tha National Survey of 
Compensatory Education, one of the first projects coTOissioned by NIE. 
A second Interim Report is due in September, 1977, and tha Final 
. Report will be prgaented in Segtember, 1978* 
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^ Consider the feasibility, costs, and eonaequencas of alternative 
means of dlatrlbutini lederal conpeniatory «ducatlon funds 

NIE's research Is Intandad to help Conirasa during its daliheratlons 

on the future of Title I of the Elamentary and Secondary Educatioii Act. 

NIE la required to Mtamine conpenaatory «ducation, la gtneral, and to 

pjrovlde Congress with specific recoiiaiendacions about the range of posalblt 

objecclves, funding methods, administrative techniques, and educational 

prograais. . 

The provisions of Section 821 can be seen as including two major 
requests from Congress. The first requires NIE to assess the current 
effectiveness of compensatory education programs in aeeting their fund- 
aaiental purpoaet, and the second charges NIE with an wtamlnBtlon of alter 
native m«thoda by which the effectiveness of compensatory programs might , ■ 
be improved. This paper describes the aajor research projects which have 
bean designed and which together will enable the Institute to respond to 

Congress' requests. 

The design of the Nil study illustrates how the evaluation of progrt^l^ 
effectiveness has developed In recent years. A decade of eseperience witfi 
evaluating social progratta has made apparent to researchers the diff Icul 
of performing any sort of straightforward "Input-output" analysis of the 
effects. The charaeterlstics of a Federal program can only very rarely-i 
directly to chaniealn, foe exmple, average reading proficiency. Event 
and outcomes are instead influenced by a large mtmber of Independent 
facttora, which both determine how the lederal program really operates ar 
may themselves be changed by it so that it Is difficult to saparate out 
,the "rederal" impact. 



In assessing a progtsa for puffposeg of l^roving it (or Judging 
whethar it can ba tap roved ) , evaltjatora therefore cannot stoply matGh a 
prog^Em's eharacteristlcs as eoncelved by its originators with si^mary 
onteoma maasures. 

A large number of other faGtora whieh affect progrm implssiemtatlon 
or joint affect the prograa^i ultimata concaTOS are also relevant* Thu 
in the case of Title I tha extant to which the progrm in faet eraates a 
net incraaae in the ^ount of money being spent on its target population 
or the extent to whieh funds are being used for instructional programs 
which genarally have been found effective may be more sensible topics for 
a larga^scala evaluation to examine than the overall Impact of the progra 
on chlldran's achiev^ent scores, 

The NIB Compensatory Education Study therefore is concarnad with a 
wide range of factors affecting the oparatlon of Title 1# for this reaso 
large number of separate but complementary studies were Implementedi rath^j^ 
than a single large-^scale evaluation* Moreover, this same research 
strategy follows from a second daiportant consideration In the evaluation 
social progrMtti- effectiveness. Such progrms can and, ganarally do have 
multiple purposes; thiSp as well as the large number of Independent factory 
aff acting thalr ^^lamentation and^pa&t, r squires that programs be 
evaluatad In tama of a number of dlffarant outcpma measures « 

To identify the fundamental purposes of compensatory education^ Nil 
studied tha provisions of Tltla I and its various amandmants, accompanyii^ 
Rouse and Sanata Reports ^ and Congressidrial debates. Those sources 
indicated that Title 1 of the Elementary and Smcondary Education Act had 
' three funiaaantal purposess * 
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* To provide financial assistance to iehool discricts In relation 
to their nMbers of low--lneome children andt within those schoul 
districts, to schools with the greatest nrahers of low^lnceae 
studanta ■ -.^ - 

* To fund special eervices for low-^achieving Ghildran in the 
poorest schools 

* - To GQntrihnte to the Mgnltivei emotional * lOcials. or physical 

development^ of partioiFatlng students 

In its recognition that the progrm has several purposes * HIE's 

strategy for assessing eeiapensatory education ptogrms differs from the 

early national evaluations of ^itle I« They considerad Only the third 

' ... 

fundmental purpose ™ contrihuEing to ahildten'a development — and often 
rendered Judgments on the efficacy of the prdgrm without accounting for 
the diverse ways in which Local IdueatlQii Agencies (LEAa) had implemented 
it* The Institute's research la designed to provide clear information 
abbut what Title 1 is accomplishing toward achievement of each ftmdMiental 
purpose* In addition* it escaainas the feasibility and effects of alteraat/^^ 
ways of organising Title I » with particular emphasis on alternative 
procedures for allocating funds » 

The overall study cossiats of 35 research projects, organised into 
the four areas of funds allocation, compensatory services, student develo| 
meat, and adminiatratlon* This paper describes the major research pro jeci 
which NIB is r.onducting in aach of these areas, - 

I. ITODS M.LOCATI0N 

NIE^s research on funds allocation is dealg^ed to assess the ways in/ 
which the eKlstlng system for allocating compensatory education funds ser 
Title I's f^st fundamental purpose ~ providing money for districts and 
schools serving low-income children t It also deacribes research an possl 
alternative alloeatlon methods which were prominent in Congressional deba 

o 
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about Title 1 in 1974. FallDwing a brief review of tha- current funds 

allocatioo syBtem^ three principal research areas are disctiaaed* 

^ ResearGh On the f mditig^^atterma created by the current 
allocation system. 

^ Eesearch on the effects of possible changes in the definition 
of poverty on the allocation of Title I funds. 

^ Research on the effects ^f ehwging the Title I eligibility 
critaricn from poverty to achievement* 

REVIEW OF CUMENT FUKDS ALLOCATION BtSTm . 

At present y Title I funds are dlatrlbuted using an allocation syitem 
which involves a number of calculations and types of data. The following 
lection brief ly reviews the process through which funds are allocated to 
school districts, and thra to schools and students within these districts 

Procedures for Allocating gunds to School DistrlGts 

Title I, which In Fiscal Year 1977 will provide over $2 billion for 
elementary and secondary education, provides for grants to LEAs and to 
SEAst The title has two sections i Fart A, funded at $2.05 billion in 
Fiscal Year 1977 t which provides gr*nts to LEAs ^ to State agency educatlo: 
programs I and to the Bureau of Indian Affairs | and Part B, fimded at $24* 
million, which provides grants to States with "high effort," and under wh 
the States choose LEAs In which to fund special projects, CHlgh-effort 
States are those in which the ratio of non-^Federal expenditures on educat 
to personal Income is high*) 

NIE's research focuses upon the allocation of fart A grmts to LEAs, 
'Riesagrante accoimt for 83.1% of total Title 1 expenditures. 

An LEA* i allocation under Part A is determined by formula* For each 
: :__;ich©ol*age child from a low-Income fmily, tha LEA li entitled to a leder 

o 
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grata t worth 40% «f the average per-pypll e^eaditure in that State, An 
lea's antitleaent, thereferai. is computed by multiplying the nmber of 
formulae-eligible children by the cost factor of 40Z of the Staters mveragf 
per^pupil expenditure* Sewavert the baseline from which the coat factor 
is estijaatad caanot succeed 120% and cannot fall below 80% of thfe national 
average per-pupil e^enditure. Because the appropriations for Title I 
fall short of the level of autheri^ation, LEAs do not receive full entitl 
ments of 40%^ but only about 16% of the State es^enditure for each 
eligible child. 

There are several categories of eligible children. For the sake of 



clarity j eligible children were referred ta earlier as school-age ehildre 

from low-'tocome famiiies* To be iwre precise ^ these eligible for coimtln 

in determining LEA grants include the following i 

® Children aged 5 to 17 ^ inclusive, from families below the 
Orshansky poverty level (a set of 124 poverty lines, each 
appropriate to a different family type)^ 

^ Two- thirds of the children aged 5 to 17 frpm ffflnilies receiving 
payments andat AFDC which total more than the current poverty 
level f oif a ndnfara family of four 

^ Chtldren aged 5 to 17 being supported in foster homes with public 
funds or living in institutions for neglected or delinquent 
children, which depend on the Local Educatior* Agency for 
educational services 



The income and AFDC data required for the forauld are readily availi 
for the entire Nation only to the county level* As a result, the IT. S. 
Office of Education applies the aanda4^,d formula only to this level, and 



The Federal poverty definition, named for its developer Itollie 
Orshansky, sets poverty-level Incomes by estimating the coats of 
adequate diets for different siiea and t^es of families, and the 
typical costs of other goods and services. It was incorporated 
into the Title I formula in 1974, 



it delegates to the Statee the responsibility for allseating county grants 
to LMe, iM eases where LEAs are not aoterminoua with comities* These 
aubasunty ailoeatioas, which affect moat LMs, must be based on counts of 
low-ineomje children, and States are required to use procedures and data 
approved by the ComiasiOGer of Education* 

Broeeduras for Allocating Funds Within School Districts 

LEAs have considerable control over the Title I funds allotted to them. 
Although their use of money ia governed by a nmber of Federal and State 
ragulationa and guidelines , theae rules leave the lEAa latitude concerning 
which achools and pupils to select for Title I prograaa and how to distribute 
the federally fmded resotirces among these schools ^d pupils* 

The regulations have two major objectives t (1) to ensure that Title I 
services go to aehools in the poorest areas and serve the loweat achieving 
students in them; and <2) to ensure that servicea paid for "wtth Title I 
funds are additional to those that all students in the district receive or 
would receive in the abaanee of Title 1* 

In selecting the recipients of Title I services, LEAs are expected to 
make the following decislona: 

^ Identify tllgible aahOQla froa aaong the schools in the district 
by using ^ paver ty cfltarion 

Select target achodls (that la, decide which of the eligible 
gchoola will, in faatj receive Title I services) and diatribute 
aervicas Mong tht schools 

Identify eligible atudants in targe achools by using an 
educational aehieveffient criterion 

' Target itudents in greatest need of asalatance 



fWmWG BMlTEmS CEEATID BY TOE CtmiNT ALLOCATION SYStm 

Thm fiyst part ©f the research on funds allocation esncarns the 
eff eats of the Title I fusding procedureg described above on the actual 
allocations of compensatory funds received by different itates, counties 
and school districts. It also deicrlbes the relationships between Title I 
^d other educational expenditures. 

Analvses of the Distribution of Title I Funds Mom Categories of States ^ 
Counties and Schdol Districts 

The primary concern of these analyses is the degree to which Title I 
is fulfilling its first fund^antal purpose — to provide financial 
assistance to school districts serving low-Income students. The research 
therafore explores the relationship between the Incidence of poverty In a 
school district and the size ^f its Title I grant. It also investigates 
whether social and demographic characteristics other than poverty are 
related to the slEea of grants, _ 

To conduct these analyses > Nil has assefflbled data that enable 
researchers to categerlae Jurladleations according to a nimber of indices, 
such as the size of Title I grants, nraberg of eligible children, population 
size^ school enrollment, raclal/athnlc coBipoeitloni family income ^ region, 
and urban'* rural and ttetropolitan'^nonaetrQpolitan status. 

These data can provide a full picture of the allocation pattern 
created by the current Title I system of formulas and procedures* For 
example. Nil will determine what parcentage of Title I funds goes to central 
city school districts. The Institute also will compare these figures to the 
percentage of the Nation's school children enrolled in these districts and 
to the percentage of all poor children who live in these districts. Similar 
analyses will be performed for each of the other demographic indicators* 



In additloa to deecribini the overall diatributioa of Title I 
funds, the atudy ^11 examine the effects of, for example, the cost 
faetor, the reduction procedure, and different definitions of eligible 
children on thij distribution. 

The elements of the Federal formula for allocating Title I funds do 
not fully control distribution of such funds. As the at^ary of funding 
procedures has indicated. States have some discretion in allocsting funds 
to the large number of LEA.S that are not perfectly cotermineus with 
counties, and this process may affect the eKtetit to which funding patterns 
parallel those impliad by a description of the programfa formal requlrMenti 
and characteristics. For this reason, a study of subcaunty allocation is 
being conducted to provide information on the procedures and data used by 
States for this purpose. For those States in which subcQunty allocation 
prQcedures are significantly different from the Title I foraula, the study 
can approKtoate the differences between the amount of money reaelved by 
various types of LEAs under the current process and the amount that would 
be received if the formula were applied directly. It irtll also contrast 
the advantages and disadvantages of the flexibility created by the current, 
mlMd Federal-State system that allows States to select data and update 
counts* Finally, the study will assess the feasibility and desirability of 
several different approaches to subcounty allocation. 

The study has already provided information on the procedures and dat 
used by states to allocate funds to LMa* The fflajority of States use 
formulas that parallel the one used by USOE to allocate funds to coimties. 
More than half the remaining States use formulas that attempt to overcome 
the age of the 1970 Census data by emphasizing total counts of AFDC childrei 

- ■ -lo 



In additioaj the study shows thatj althgugh more than twe-thirds of the 
States use Census data, fewer than half of those States use ichool district 
Census data compiled by the USOE. Instead, States use their own matching 
of aohool districts ^th Census areas. Other practices were identified in 
several States which affect the subeounty allocation process * including 
such practicea as (1) reallocating "unused" funds, (2) redistributing funds 
among counties, and (3) altering the "hold-harmlesa" procedures mandated 
in the Federal regulations .2 

Title I Effects on the Distribution of Educational Expenditures 

Federal eompensatory education funds are intended to help determine how 
education resources are distributed among the Nation's children and to 
Increase the level of educational resources available to children attending 
schools ir* low-income areas. When assessing the topact of the current Title 
allocation system, it therefore Is Important to consider its effects on the 
overall distribution of educational resources among different types of school 
districts. In collaboration with HEW*s Office of the Assistant Secretary for 
Planning and Evaluation, Nil is conducting analyses to eKamlne how' far 
Title I and other federal education programs currently are effective in 
changing the distribution of educational resources MOng different types of 
districts. The focus la on whether funds are redistributed In favo: af ' 



Nil is also conducting a study of the poverty measures used by 
districts to allocate fundi to schools* The study will provide 
information about the relationships between a school's poverty 
level and the ^ount of funds it receives and will also assess 
the esctent to whch funding patterns differ as a function of the 
particular poverty measure used, ' 
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distrlGts which can be considered poor in terms of their mediaii income , 
number of poar children, tax base, or escpendicures per pupil, 

NIE ±B also studying the impact of Title I spending on total educational 
spending by LMa. In establishing Title I, Congresi Innended that there 
should be an increase in the real level of educational spending in recipient 
diatricta. It did not intend that the funds should serve merely as a fom 
of tax relief, allowing LEAs to cut back on local spending. Therefore, 
Title I regulations include a "maintenance of effort" provision whereby LEAs 
must maintain their previous levels of expenditure, 

Mthough these provisions make it ^possible for an LEA sifflply to 
replace local funds with Title I money, a district receiving funds from an 
outside source may raise less additional monay from local sources than would 
otherwise have been the case. During a period of inflation, when additional 
local funds are needed simply to maintain a given. level of expenditure. 
Title I funds may be used to replace additional local taKes that would 
otherwise have to be raised. 

In light of these possibilities ^ a study was initiated to determine 
the degree to which Title I has succeeded in raising levels of educational 
expenditures. Although the analyses are incomplete i it appears that Title I 
fimds have been effective in raising expenditures on education* Approximately 
two-thirds of Title I funds are spent on tttuly additional educational 
services that would not have been purchaaed'^ in the absence of these funds. 
Compared^ to noncategorical State grants programs, Title I funds haye been 
more effective in increasing total expenditures^ and far less likely to be 
used to support tax relief . 

- 12- 
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^TEEBaTIVE MIASUMS op POVIRK 

D±asat±afaQl-lon with the esd^sting pattern of funds alloc^^^ was a 

major reason for the 1974 changes In the Title I formula. The most 

important of these changes was the adoption of the current "Orshansky" 

method of identifying poor families from Census figures. 

: VT&^touslyy a sUngla-family income of $2,000 a year had been used to 
.define poor families for program^purpos and the ohildren living in such 

families were counted in order to determine the aliie of Title 1 grants. By 
- adopting the Orahansky index, which distinguishes different types and sl^es 

of family, and is regularly updated, Congress both refined the definition 

of poverty in use and brought about substantial shifts in the pattern of 
funds allocation* ^ . . 

The adequacy of counts based on the Orshansky poverty index continues 
to be questioned, for this reason * the Educational Amentoents of 1974 
mandated three studies related to a poverty^based allooation fomula. One 
Is a study of methods of updating poverty coimts, currently being conducted 
by the iecretarles of Comerce and Health* Iducatlan, and Welfare. A second 
closely related study is the Survey of Income and Iducation^ which will 
produce acourate counts of children in poverty in 1975 for each Ctate. The 
third is a Study of She Measure of Poverty ^ supervised by the Assistant 
Secretary of Iducation. ^ ' * 

= Nil is currently conductlni research on a number of alternatives for ^ 
measuring poverty, Hiese alternatives derive from the study of The Measure 
of Poverty, and also from recent work by Orshansl^. The purpose of the work 
on alternative poverty measures is to determine the degree to which they have 
differential effects on the allocation qf Tlfle-^^^^unds, 
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Saveral measures will be studied. Nil is first examining a set ©f 
variations in the Orihansky poverty matrix which have the effect of 
shifting the current poverty definition up and down* SeGOnds it will 
es^nine several variants of the Orshanaky definition i although they use 
the eanie general standard of povertys these variants reduce the niaaber of 
family oategorlei and employ different data and methods for updating the 
poverty income level. Two measures baied on more recent definitlona of V 
and data abouts the coat of adequate diets will be studied. Finally, the 
analysis will include two definitions that differ sub,3tantially from the 
current definition I one uses a single cutoff for all frillies, and one 
uses the Orshansky cutoffs but applies them to "pretransf er" Income (income 
excluding transfer paj^ents like AFDC and public asalstance). 

AliOCATION OF imroS MSm) ON 

Of the changes currently proposed for the allocation of Feder 
compensatory education funds, a shift from poverty measures to achievement 
scores Is potentially the moat far-reaching * Prior to the passage of the 
Iducatlon Amaniaents of 1974, there was intensive discussion of the desir-* 
ability and consequences of allQcting funds to States, districts^ md schools 
on the basis of their nimbers of low^achieving students. Although no such 
procedure was adopted, the Congressional mandate for this study instructs 
the Institute to eKplore alteitiatlve methods for allocating compensatory 
education funds* 

Nil is conducting two studies to examine the potential effects of a change 
to achievement criteria.: However, the choice between allocation using 
achievment scores and alloctlon using poverty counts cannot be made on the 
basis of reiearch results alone. It dapands ultima taly on a political choice 



about the characterlatics of places and persons who are to benefit from 
funds the progr^ provides. Nil's research can illuminate the practical 
consequences of a change in methods of funds allocation, but it cannot 
determine which method la "beat" in a philosophical or an ethical sense. 

To advocates of achiavement-baaed funding, the appropriate way to 
distribute education frada la on the baala of children's educational 
performance. Since the ultimate aim of compensatory education la, they 
argue, to increase children's achiavement, the beat formula for distributing 
funda must be one which targets money directly to the children^ w^^ : : 

acadmlc performance Is low. Supporters of achlevement-baaed funding regard 
poverty meaauraa as proxies for low achlev^ant i hence they argue that these 
measurea do not efficiently Identify low-achieving children. They favor 
using nOTbers of low-achieving children to dlatrlbute Title I funds, instead ■ 
of numbera of children in poverty* 

This view contraata with the opinions of others who favor the use of a 
poverty criterion. They do not se aolaly as proKlea for 

a measure of low achievement , nor do they believe that using poverty as the 
Title I eligibility criterion must :be J us^ Its ability to 

identify the States, distrlcta, or achools which contain moat low-achieving 
pupils. Some advocates of a pevefty-baaed allocation formula believe that 
the major role of a compenaatory education progrM is to channel additional 
resources into areas where children are poor. Others believe that the purpose " 
of compensatory education programs is to help low achi^^ they argue 

that the low-^achieving pupils in poor areas must be given priority. 

Though the philosophical differences between these two points of view 
are clear, the practical consequences of the choice between poverty and 
achievemenc may be less dramatic, A change in eligibility criteria will - 



make a difference in Title I only if it produces a different distribution 
of ftmds. Although th« individual level correlation batwean poverty and 
aehlevement is far from perfect, the correlation betw.an the numbers of 
poor and low-achieving children in a State, LEA, or school could be high, 
even if the individual level correlation were low. . A achool, dlstrleev or " ' 
State could have high numbers of poor and_of low-achlavlng students, even If 
very few students were both poor and low achieving. At the present tlaie, 
the degree of overlap between counts of poor and of low-achieving students 
at the levels of States, districts,- and schools is not known. 

The purpose of NIE's research on achievement scores Is to explore the 
practical eonsequenees of the choice between poverty and achievement as 
criteria for allocating Title I funds. One part of the research focuses on 
the degree to which a change to an aehlevement criterion woold, in fact, 
affect the distribution of Title I funds among States MdLlAs. Another 
part of the research concerns the availability of the kinds of data needed 
to support an ac^^^nt-based funding system. A third part of the research 
explores the effects of adopting the achievement criterion on the operation 
of Title I within school districts — on the Identification of students to 
be served and the services received by students. 

Because the technical problems of allocation of funds to States and 
districts are different from those of Sd.thln-dls trie t allocation, the research 
oh achlr^rement^based funding is divided into' two par tsV (1) alio cation to 
States and school districts, and (2) allocation t^thln school dlscrlGts. 

AlloeatlQn to States and Districts 



Nil's work in this area comprises three efforts: (1) obtaining comparable 
-achievement data for as "many Stites and their constituent school districts as 
possible, "for estimating the distribution of low-achieving pupils among Stat 



es 



and distrletsj <2) estiosting the patterne of funde allQcation which wuld ■ 
raiuit from a ehange to achievement-baBad fundlngi (3) aiseising the eoita 
and feasibility of several atratagias for obtaining data to pemit a ohange - 
to aehiev^ent-baasd funding to Statei and ichosl districti, ; v ;^ 

Under the first efforts all Statea were aurvejred and all potentially : 
usable data oolleeted. Both State aggregate at^d distriet-by-diatrloc 
aehlev^ent data were obtained where available. Because the States and 
distriota use a variety of aehievement tests --^ and adminiiter them to 
different samples of pupils at different tJjiea in the aeademie year the 
data files obtained from the States generally are not comparable ^th one 
another.. The various files have now been adjusted uaing the ^chor Test 
tables (procedures for equating results of different tests) a^ 
teclmiques developed espeaially for this study. Though some of the State 
and die eric t aehievement score files may prove impassible to equate with 
others, it appears that a tat wide achievement data should be available for ^ ^ 
more than half the States, and dlstrict-by-dlstrlot data for about orie-thirdH 
of the States. •■ :. v 

Hie second*- effort will co^arrpatt^ eligibiliSy^d™^^ 
funding imder achievement-based ftmdiag with the results of several poverty- 
based title I funding systems, including the one now in force. 

Under the third effort, five altematives are being e^caminedi 

^„ , A national ^^r^ teatlng progrm'that 

wotild provide completely standard student ach 
for every school district 

• A simpler national testing program which would produce national 

and statewide achievement figures Cpoasibly from a vei^ short ^ ^ 
"screening" teat or other device reducing the test burden on 
studenta and teachers) Mth sub-State allocations relying on ' 
separate (e.g. , Stat e-rm) testing progr^s 
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V - A national data base obtained by eollectiag, equating > atid^ ' 
standardizing diverse Statm tasting programs 

, ' ® CpmblnatiQas of the above jWhieh may use one data base for 
funds allQcations among States and others for sub-State 
■alloeations r -^^ ^ v • , 

: ^ ® The use of poverty or other Census-based data to alloeate 
funds among States* and the use of the respective States 
achievement testing programs to allocate funds to their 
: constituent school diatrlats 

These alternatives are being evaluated according to thair coati 
accuracy, freedom from bias, and public accaptabillty, by a mat^onai 
panel of experts in the field of achievement testing- 

Intra-Distr let ^location 

The question of ait ernacivas to current intra-dlstrtct allocation 
procedures is addressed by the Demotistratioh Studies, The WndatV 
offered an opportunity to study changes in Intra-dlstrict alloimtion in 
action. The wording and history of Sections a21(a)(S) and 150 indicate 
that Congress intended these studies to be "working mode of types of 
allocation changes which had been proposed during deliberations on the 
Education Amendments of 1974^ Through these demonstrations being 
conducted by 13 school districts across the country, Nil tdLll gather 
information of practical use to Congress in considering changes in the 
process of Intra-district funds allocation. The research^ll provide 
infomation about the effects of new ways of allocating Title I funds on 
the kinds of -schools and students served imder alternative allocation 
strategies^ the numbers of students served, the instructional services 

they raceive, the programs and delivery systems developed by school 

■ ■ ■ ■ ^ 

fUstrlcts, the extra costs (or efficiencies) associated with different 
allocation patterns^ and comunity support for the Title I program i 



, Xvi designing the study to respond to these concerns, NIE focusad sti 
two major policy options. Specifically, districts were 'aaked to consider 
r changes . Ini r-.- v^-". 

- School eligibility criteria — districts were asked to select 
.:, * , either alternative poverty criteria for school eligibility, 
or a criterion based on achiev^ent rather than poverty . 

® Concentratibn-^dia trie ts vera asked to consider aerviag 
more or fewer schoola * and more or fewer students . within 
schools 

The most popular alternative allocation procedure selected iby the 
demonstration districts was allocation by achievement measures rather than 
by poverty, and most districts elected to serve more schools and/or more 
students than previously. The major reason : of £a;^ed was a desire to serve 
low^achieving students directly regardless of their attendance area or the 
school In which they are enrolled. ^ 

To observe the effects of those changes j Nil deslgnad a 3^year study 
in the demonstration districts. Under the design, districts continued to 
operate Title I programs using standard allocation procedures in the 
1975--76 school year, while planning the specific details of the changes 
they would make p During that^ year pre-^change data on all outcome' measures 
were collected, against which effects of the demonstrations would be 
measured. During school years 1976-77 and 1977-78, the demonstratldn 
districts are operating under the new allocation procedures, and data 
on the same measures are betog collected* " 

The major objective of the dMonstratlon, study is to examine the 
intact of the districts V changed allocation policies on a number of out- 
come measures. The pr^ary research questions are as followsi 
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^r^^^^^^^^^^^^-W W^ changes in Title I allocation policy have 
V "r?^^^^©^ administration of compensatory 

: progrMs and ^thiti 

-rr^^ - 

What effects do changes in Title I allocation policy have on 
the instmictional and support services es^erienced by studanta 
; ^*:di£iMeat types within the dMonstrati ^ 

^ What effacts do changes in Tltla I allocation policy have on the 
^^siipQ^iition (presarvice achievament lavel, aconomic status s 
: attaiicity, etc.) of the schools students served by Title I 

within the demonstration districts? 

° What effect does achievement-basad allocation hava on teaching 
and testing practices within the schools? Is there any evidence 
of negative incentives created by a schaol^s awareness that 
success in raising students^ v achievement levels could decrease 
■ " the school's funding in following years? 

® -What are the administrative costs and/or savings associated 
with changes In Title I allocation policy? What costs are 

- Mnracurringp such as costs associated with plann 

costs are recurring, such as costs associated with testing? 

^ What is the reaction of the coimunity (especially parents) to 
changes in Title I allocation policy ^d.phin the demonstration 
districts? 



^ Wiat effects do changes in allocation policy have on the 
achiaveaent of selected students within the d^onstratlon 
districts? (This outcome': variable will be e^^lored for a 
subsai^le of districts depending upon the availability of 
adequate data for such an analysis, ) ' . 
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smvicis . 

0^ the research pro jaeti eonducted f©r the ' 

Gompensmtory Education Study is the National Survey of Compensatory 
Education- This survey reflects Nil's strategy of evaluating compen- 
aatory education through a number of complementary studies concemad 
^th the. d.^ff erent purposes of compenaatory programs and with the many 
factors aff eating how well chase purposes are attained , The survey 
is designed to assess the effectiveness of compensatory programs in 
achieving one of their purposesi providing improved services to 
children with special educational needs* M evaluation of how wall 
Title I is succeeding in funding special services related to such 
needs is crucial because unless a compensatory pro grm can provide for 
services effectively, it clearly caimot be of direct help to children* 

Under Title I, the Federal Government does not deliver services 
directlyr it does so through the actions of LEAs. Individual LEAs 
therefore asarae a major responsibility for the quality of Title I 
services and the sms is true for compensatory sarvlcas funded by 
individiial states. The National Survey of Compensator is 
providing inf omation about the characteristics of services f imded by 
Title I and by state compensatory programs in a national random ample 
of Title I school districts. Districts which included some grades in th 
ranges from kindergarten through Sth grade were selected for the survey. 
Data were obtained from totervlews conducted during the igTS-^Te school - 
year with State and district administrators ^ school principals j regular; 
classroom and compensatory education teachers, and parent advisory 
council chairpersons. 



r The iurvay was dasigned to provide Information ons 

the kinds of instructional and supportive servloes which 
school districts provide with companaatory aducation funds 

® the character is tics of students receiving thesa services 

■ the characteristics of the Instructional services provided 

whether the services are sufficient to have a reasonable 
chance of acco^lishlng their goals* - 

Analysis of the data Td.ll provide a comprehensive pictura of • 

the current operation of compensatory programs by school districts. 

Preliminary results are already available, BXid they are described in 

a complementary paper by NIE Conqpensatory Iducat ion Study staff • 
(The Str ucture and Cantent of Compensatory Education Programs i Joy 
Frachtling and l^rgot Nyitray), Z 

STTOEliT DEVlLOJIdEOT 

The Nil Compensatory Education Study is also concerned with the 
effectiveness of compensatory programs in contributing to the overall _ 
development of participating students. This third of Title I^s funda- 
mental purposes has received far more attention in previous evaluations 
than have the provision of financial assistance to school districts or 
the examination of how effectively improved services are being 
delivered to children with special aducational needs* However , It is 
these evaluations , with their Mphaeis en chUdran * s development » 
which. have made apparent the impossibility of establishing a direct link 
between „ fedaral compensatory fimda and maasurad gains In students' 
cognitive! emotional ^ social or physical growth* They have shown that " 
the topic is complex, that national avaluationa era difficult to do 
well, and that useful information cin.be gathered only when studies are 



Nil has therefare not attempted to provide svaluatloni : 

of the ovarallef facta of Title I on student development* Instead 
the studies foeus on the relationship between ehildren's aeademift 
perfotfflanee and Important aharaateristies of instructional prograss 
which can be contralled by educators and policymaker sV They eKa 
the prevalenae of these eharaeteristlcs in compeniatery edue 
programsi and how the adoption of the most effective of thee a can be 
promoted by the desigm ^d atoLnistration of a Federal aompensatory 
program,. " - ' ■ 

One toportant reason ^ ^f^ in examining . 

Title l^s third fundmental purpose is that the program fimds a variety 
of different inetructional and support aei^ices* , Earlier national . 
evaluations were structured ae, if .Title I funded very slad.lar services 
to children across districts s which could be assessed ustog a single 
outcome measure — student achiever* ^nt- However, the assimptlan collid 
with an Jsportant truth. about Title I: it does not provide one series 
but many, for eicample^ Title I funds breakfast programs for students^ 
This use of Title I funds might. In the long run, enhance aehleviaent . 
Nevertheless* immediate gains la achievCTent through such expenditt^es 
are unlikely » and the use of achievement tests to measure the short* 
tera li^ect of such progrems is inappropriate* ^ . . . 

• Secondv ^ the art ©f measurement is not uniiarmly well advanced ^ 
in all , areas _o^ student development * \ AlthougW Sitle I is , intended to 
improve not only achievement but also the emotio^aal and social growth 
of participating students^ there are no genermlly^f accepted and broadly 
applicable definitions of such growth i and measures of outcomes in 
these areas are correspondingly unsatisfactory. Generally accepted 



measures- for aestssing outMmes currently are available only in tha 
area of cognltiva devalopments and even in; that area some important 
abilities gueh as creativity and independent thinking eannot adequately 
be measured* Aahievement outcomes, par'jicularly in reading and 
matheoaclM , t^ain the only area in whifth satiBfaetory meaiurea are 
available for formal research p and NIE*s work on student development ^ 
therefore focuses on aQhievement outaomeo. This approaoh la valid so 
long as it remains clear that the reeearch reflects neither the full 
range ©1 services intended to help children develop nor all the possibl 
Impacts of services on children. " 

Finally, although programs designed to increase achiev^ent in 
reading and mathematics are the instructional services most frequently 
delivered to Title I children^ these progrOTis vary considerably , and 
^^^luations designed to assess their average effect on achievement can 
be misleading. School districts use a variety of las tru^tional methods s 
some of which may be more affective than others. TheAappllcation of a 
s^ary maast^s across different t^es of reading and mathematics 
pragrMS Is likely to mask this variation In effectiveness. 'Such an 
avaluatlonp therefore* may show no significant increase In overall 
^chievCTent, even If particular progrsMs or parts of programs are 
producing dramatically superior results. To conclude from such data 
. that Title I has failed to increase achievement — a frequmt eonclusion 
of s umma ry evaluations conducted in the past — seriously underestimates 
the ability of properly conceived and implemented sarvlces to raise 
student .achievemem. Further , the stMary data of far little Inforaation 
for educators and polic3^kers who are looking for ways to provide more 



On the basis of these considerations, NIE CQiicluded that the most 
useful t^e of Study would be One specifically designed ta exMlne the 
relationship between achievement on the one hand ^ and vai^lations in ■ 
pTQgTBm features on the other. This approach makes it possible to ■ 
exmlne the extent to which compensatory funds are being used for the 
kinds of tnstruetianal programs which have proven^^^ 

The results can also provide Congress with information about whether ^ 

Title I program requlrfflients promote the adoption of effective 

- , ... ... I 

instructional approaches j and provide educators with additional help 

in planning compensatory progrmis. 

The resulting studies of the relationship between selected program ^ 
charaaterlstics and achievment focus on four features of instruction 
.which : appear to be . especially.;^important^ in determtoing^^ children - s ^^^^^ 
learning. These arei individualized instruction ^ instructloaal 
setting, time spent In instruction, and teacher training. 

The major research eKamining the relationship of these variables 
to student achiev^ent is the Instructional Dimensions Study which includi 
12 j 000 first and third grade students In 440 classrooms*- The study ^s 
major purpose is to assess the effects on achievement in reading and 
mathematics of variations in individualized instructional methods and 
in instructional setting (miinstr^^rm versus pullout instruction) .3 
Iff eats of instructional tjae and teacher training will also bs examined, 
as will the i^act of different program characteristics in such areas as 
students- attitudes toward reading and mathemtics and their class 

attendances ■ •• - 

- . ~ . . - - . ■-■if - - - ■ - -■■ . ................... . ..... 

3 : ^e definition of Individualized instruction used in the study Includes 
, only specially structured curricula' 'rf.th the following four character- 
is tics : specif Ic learning objectives assigned to individual children i^i 
small- group- or Individual pacing r diagnosis and Individua^^^ 
and alternative. learning paths and sequencing for individual chlldren- 



ADMINISTRATION : 

The earliest evaluationa of Title I tended to ignore the 
eKlstence of the complex educEtional hierarchy lying between the 
design of ; legislation ^d appropriation of fundi in Washington, and 
the student outeome measures whieh the evaluations ware designed to 
measure, HQwaver J the adffiinistrdtive decisions made at each level 
of govariment profoundly af feet the implementation of compensatory 
education programs, and therefore their ultimate effectiveness. The - 
importance of studying such influences on program effectiveness is, 
as this paper has stressed, increasingly apparent to evaluatorsi 
and the Nil CQmpensatory Education Study therefore addresses directly 
the issue of progrM administration. 

Title I is implemented through a compless administrative structura 
involving Federal, State, and local levels "of govenuoerit * The Depart- 
ment of Health, Education, and Welfare and State Education Agencies 
carry out a number of responsibilities in administering Title I: funds 
distribution, rulemaking, monitoring, enforcMent, teclmical asr istanca, 
and evaluation- 

In performing these responsibilities, they interpret the wishes of 
Congress and cosmiunicate their interpretations to LEAs about who will 
receive Title I serviees and about how/ and tmder what circimstances, 
these ee^ices are to be delivered, LEAs, in turn, use this information 
in determining how best to provide Title I services. 

The way in which these administrative responsibilities are carried 
out can influence Title I*s effectiveness in a n™ber of direct and 
Jaiportant ways. For eicample, clear articulation of the allocation 
regulations and procedures , and the collection and use of up-to-date - 
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data cmn IncrMsa the probability that funds are isdemd targeted 
to the appropriate echoolg and atudents. Timely funding q&cl improve 
the ability of LMs to plan and taplament Title I progrms* Good 
technical aaiistance from Suites to LEAi can help keep districc 
personnel in touoh ^th recent findinge on program design. 

Given the adminietrative atruetti^e that haa been established, the 
_ . . „ . .?3^??e8i_0f _tho^ in af^Ti-f^ty-fng fi-g objectlvas d-pcnd:: cn 

the quality of nanagement at each level of goveTOment and oti the nature 
of the interactions among the levels. The complexity of the atolnistra^ 
tive structure also places vary real l:taits on the abilit^'of Congres 
to bring about modifications In Title I* Altbiugh Congreea is In a 
position to exert fairly eKtensive Influence on federal ad^ ^ 
behaviori It has less direct control over States and even less over LEAs* 
Therefore* in order to make recosSQendations for ImproVCTents In Title I 
thaL have any real chance of affecting local district practice* more 
Inforaation about the ways In which HEW and the States administer Title I 
and about the effects of those administrative activities on local 
districts la needed. 

In order to address these issues * Nil Is conducting several 
research projects on the atolnlstration of Title I» Th^^^ have three 
major objectives I 

° To describe the process by which adminlstratoi; j transform 

the provisions of the Title I statute into educational services 

; ^ To identify, to the 'extent possible, the faetors-that affect 
. the way in which the Title 1 program has been ir l^amented 

° To determine whether (and In what ways) Congress may be able ^ 
Influenee local Title I services through efforts to modify 
administrative practices » 

erJc 
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The major research projects are iussBarl^ed below. 

STUDY OF LIGM. STAND^S 

The FederEl Goverraient^s administratiom of Title I la haaed on 
the legal frmework under which Statea and LEAs must operate. The 
frmawork Includei the Title I statute , regulations, guidelines, program 
directives 5 and formal letters of advices all of which elaborate on 

. „ — eonttr at aelning' ^fio* ISie^ ^st a £u^ elT ' ^T^a^^HuWf^ ^r ait¥"^all°^ 

of these elements of the Federal legal fr Rework* It will provide a 

aoaplete account of the eKiating l^gal framawork^d an analysis of Its 

Impliaatlona for the operation of Title I, It has five basic objeetlvea: 

^ To analyze the Titla I statute and regulations in order to 
identify areaa in which they may be unclear or inconsistent 



To analyze the guidelines, progrM directives, rad adviaory 
letters in light of the regulations to aaaeas the clarity 
and coasiatency of the overall Title I legal framework 



To examine various ways the Federal GoverMent has chosen to 
cQsmunicate and disseminate the legal framewrk to States and 
to local districts 

To^^rialyze-^the^ways^lnT^^ 

tions of the Federal legal framework aj.ter the requirementa 
placed on LEAa - 

To identify ways in which the overall framework may restrict 
the delivery of educational aervices by 

STTOY OF FEDIRO. ADMINISTSATION 

In order to tmderstand the direction provided by the Federal 
Qovermentj Nil is conducting a study of the Federal atoiniatration of 
Tide I, Its objectives are aa followsi 



Q 



To .identify the areas in which the guidance and direction given 
to States and LEAs My be unelear 

2S 
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To ideatify organizational factora that may accost for any 
laek of elarity in the raderal direction provided to States 
and LEAs 

To asaesa the likely eff eeti of poaaible modifications in 
Federal adnJjiistrativs activities 

To achieve these obj actives , the study will describe Federal 

management activities ^ including the various procedures that HEW uses 

to provide direction to SEAa and LEAs* It will also analyze the 

^acK ^relivint ^iTof f ef f acV 

of this direction. Savaral specific areas of Fadaral manag^ent are 

being eKamlned, Among HlW^s important responsibilities are monitoring 

and enforcement * which it parforms by conducting annual program reviaws 

of each State and by auditing a sampla q£ States. ^ analysia of 

program reviaws J audit reports* and interviews with appropriate officials 

will provide information about the effects of such activities on SEAs 

and LEAs* Federal officials can also eicert consideriLbla influence on 

States and school districts through the ways In which they provide 

technical assistance and evaluation. In these areas, research efforts 

aijailar to these described for monitoring and enforcemMt are being 

conducted. Again, the emphasis is on evaluating the clarity and 

consistency of the directions given, the ways in which, the directions 

are communicated, and their effects on SEA and LEA practices # 

STUDY OF STATE jUDraNISTRATION 

The Study of State Atolnistration has three objectives i 

® To identify differences in the ways that various Stat^ 
administer Title I 

^ To ascertain whether these differences in State administrative 
activity have any impact on the ways in which LEAs provide 
Title I services 

o 
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® To determine whether and %f±th what affeat Congreee can 
influence the ways in whiah States administer Title I 

One cQmponent ef the research Is a national survey of State 

administrative activities to study the specifie ways in which States 

perform their reiponsibilitiea for rulemaking j monitoringj enforcment, 

teclmical aiaistance and evaluation. Kiis survey \rtll also eKami^e 

the degree to which leveral State characteristiea (e.g. , SEA organic- 

t±0!ml^^«W£LSV SE& Yett^u and cuatomary ' 

SEA interactions ^rtth the Federal tovemment and with local jurisdic-- 

tions) affeat how States atoinister Title I. 

Differences in the ways States carry out their responsibilities 

are important because of their potential ^^act on the way LEAs 

implement programs. In order to examine this Impact, Nil is conducting 

case studies to determine how selected districts treat a number of 

progran requirements* such as comparability and program design^ in the 

dellvary of services to Title 1 children^ and the extent to which 

State administrative activity has directly aff acted the approaches 

taken by the districts in response to those requirements, 

STTOY OF STATE COiff INSATORY EDUCATION PROGR^S 

In over one-third of the Spates, local districts receive funds for 
comp^satory education through State-initiated and State-funded programs 
separate from Title I. These programs have their oim legislative 
purposes p are typically subject to different rules and regiJ-ations* and 
are frecjuently administered by other units within the SEA. 
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The Study of State CompensatQry Iducation Pro gram g ^3camlnes the 
following questiona: 

® What are the differences between the State compensatory 
programa and Title 1? 

' Wiat impact do these differancea have an the types o£ 

coapensatory services LEAs provide to children and on the t^es 
of children served? 

^ What medificiitioni can be made in the overall Title I 
administrative system that will facilitate coordlnatidn 

..^ 

From the ways in which States atoinister their own progrmss 
what inferences can be drawn about how States might react 
if theregulat©^ stsucture of Title I wera reduced or if 
Title I fimds were available on a bloo^grant basis? 

A comparison of State progrims ^rtth Title I will identify differences 
between the two to such areas as program objectives, student eligibility/ 
nraber of students served, types of progrm aervlaes delivered, and 
administrative practices both at the State and the local levels t 

The study also includes an escamination of the effects of these 
differences on the delivery of services at the local level, for eMttple, 
i-t will provid e inform ation _on whether_Sta 

deliver more intensive services to children already receiving Title I 
services* to nontargeted children eligible under Title I, or to children 
not eligible under Title I. Thm study also will ahow whether the exlst*^ 
ence of a State program results in conflicts between the regulations for 
Title I and the State program that create difficulties in implementation 
at the local level. , 

In one sense, an examination of State compensatory programa may : 
todlcate how states, might admlniater Title I if the Federal Government ; 
were not involved. Therefore^ some judgments about how States might 
: V ad^ister Title I if the federal legal standards for the program were 

erJc 



ralsKed My be possible* This axaminatlQn eould ales claelfy the 
paMible ImpaeC of making Title I funds availabla on a bloe-grant 
basis, : L 
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